Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: translate ascii files prior to running standardise-publish TDE-814 #161

Merged
merged 3 commits into from
Sep 27, 2023
Merged

feat: translate ascii files prior to running standardise-publish TDE-814 #161

merged 3 commits into from
Sep 27, 2023

Conversation

MDavidson17
Copy link
Contributor

@MDavidson17 MDavidson17 commented Aug 28, 2023 •
edited
Loading

This workflow, converts all ascii files within a specified path to tiffs, it then runs standardising and publish as per normal on the translated data.

Waiting for: linz/topo-imagery#595

https://argo.linzaccess.com/workflows/argo/test-mdavidson-ascii9cc75?tab=workflow

image

sample output: s3://linz-workflow-artifacts/mdavidson/canterbury/cheviot_2015/dem_1m/2193/

Example test:

argo submit ~/dev/topo-workflows/workflows/imagery/ascii-standardise-publish.yaml -n argo -f ~/dev/topo-workflows/workflows/imagery/canterbury-test.yaml --generate-name test-ascii

canterbury-test.yaml:

"source": "s3://linz-elevation-staging/lidar2/Canterbury_-_Cheviot_LiDAR_(2015)/Canterbury_-_Cheviot_LiDAR_1m_DEM_(2015)/"
"target": "s3://linz-workflow-artifacts/mdavidson/canterbury/cheviot_2015/dem_1m/2193/"
"title": "Canterbury - Cheviot LiDAR 1m DEM (2015)"
"description": "Digital Elevation Model within the Canterbury - Cheviot region captured in 2015."
"start-datetime": "2015-04-01"
"end-datetime": "2015-04-01"
"scale": "10000"
"source-epsg": "2193"
"target-epsg": "2193"
"compression": "dem_lerc"
"retile": "true"
"validate": "false"
"group": "5"
"licensor": "Environment Canterbury"
"licensor-list": ""
"producer": "Aerial Surveys"
"producer-list": ""

@MDavidson17 MDavidson17 force-pushed the feat/translate-ascii-files branch from 94ce1b1 to dc36f9c Compare August 28, 2023 01:15
@MDavidson17 MDavidson17 force-pushed the feat/translate-ascii-files branch from 44eb2b1 to 3dcde26 Compare September 6, 2023 03:16
@MDavidson17 MDavidson17 force-pushed the feat/translate-ascii-files branch from 3dcde26 to d17d9df Compare September 24, 2023 22:27
@MDavidson17 MDavidson17 force-pushed the feat/translate-ascii-files branch from d17d9df to 98c4e65 Compare September 26, 2023 21:01
@MDavidson17 MDavidson17 marked this pull request as ready for review September 26, 2023 21:05
@MDavidson17 MDavidson17 requested review from a team as code owners September 26, 2023 21:05
@MDavidson17 MDavidson17 added this pull request to the merge queue Sep 27, 2023
Merged via the queue into master with commit 1d21d28 Sep 27, 2023
1 check passed
@MDavidson17 MDavidson17 deleted the feat/translate-ascii-files branch September 27, 2023 20:58
@MDavidson17 MDavidson17 mentioned this pull request Sep 28, 2023
Merged
github-merge-queue bot pushed a commit that referenced this pull request Sep 28, 2023
@MDavidson17
fix: add source to workflow (#183)
666cf1f 
The merging of #161 linted
against the old version of standardising so missed this required fix
which broke Wentao's PR here:
https://github.com/linz/topo-workflows/actions/runs/6333551973/job/17201837027?pr=179
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@paulfouquet paulfouquet paulfouquet approved these changes

@amfage amfage amfage approved these changes

@blacha blacha Awaiting requested review from blacha blacha is a code owner automatically assigned from linz/li-topo-data-engineering

Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@MDavidson17 @amfage @paulfouquet